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ABSTRACT ' ' * ... 

In a program Development and EvaJC^atdon model, 
guidelines are presented' for program directors at .Delaware County 
Cojimunity College* Based' on the premise that the prqcess oi 
developing . programs is essentially that of evaluating programs, the 
model includes thp following- steps for both processes: (1) involve^, 
the appropriate publics; (2) identify program goals and specific 
objectives^ (3) state objectives in measurable form; (Ul develop 
apprppriate measurement/implementation techniques; (5) implement the 
measurement., of criteria fpr the achievement of objectives; (6) ^ 
analyze the resulting data; (7) interpret the data- relative to the 
specific objectives and goals; and (13) ma'Jce recommendatiolis for 
implementation, modification, and revision of broad goals and 
specific objectives, beginning the cycle again,. An example of the use 
of a rating scale for program proposal screening concludes the model* 
*(ET) * 
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FRAMEWORK FOR J)EVELL6pMENT AND EVALUATION 



A critical aspect of an effective Planning/ 
Management /Evaluation Pro/:ess is the establishment 
of an ongoing prqces^ "to evaluate and measure « 
the achievement of prtgram and institutional 
objectives.'' ^ 



\ In order to accomplish this / the Metfe^sel/ 
Michael paradigm has been adapted to serve as 
the framework for program development and Evalua- 
tion at DCCC (figur'fe 1). ' /• 



^' . Trte basic premise of the JPME development and 
'evaluation process^, is that the process of developing 
programs is essentially that of evaluating programs • 
Both depend upon objective setting and measurement 
for success ^ 



The following guideline^ are presented as a 
framework for use by program directors in actual^ 
development and "^evaluation activities . i 



/ ^ 
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PM£ DEVELOPMENT/ EVALUATION PROCESS ' 
Figure 1 



STEP 1 



Involvement of appropriate 
publics in development/ 
evaluation process 



STEP a 



Reconnn^ndations for 
implen^fentation, modi* 
fication & revision 
of broad GOALS ajid 
specific OBJECTiyES 



STEP 7 



Interpretation of data 
relative to specific 
OBJECTIVES and broad 
GOALS ^ 



STEP 6 



Analysis of jdata 



STEP 5 



\/STEP 2 



Identify, program 
GOALS and speci- 
fic OBJECTIVES ' 



STEP 3 



State specific 
OBJECTIVES in 
measurable form 



STEP 4 



Develop appropri7 
ate measurement/ 
imp lemen t a tion 
techniques 



Measuremefit, of' qriteria 
for achievement of 
OBJECTIYES 
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DEVELOPMENT OF NEW PROGRAMS 



SlfeP 1 - Involve Appropriate Publics \ > 

Proposals for development of new pAgrams may be 
initiated from many sources. In order to begin 
the PROCESS of developing the proposal: 

* The proposal must \e presented to the appro- 
priate program director/coordinator,^ 

* The program director along with the^person(s) 
presenting 'the program proposal must perform 

a" preliminary screening by carefully con^i-deying, 
the following questions; 

- Can. this -program be successful? 

^ - Is the proposal relied to DCCC's mission? 

/ - Does the institution have adequate resources 
' to support the program? 

Will the program duplicate programs at / 

• ' ' Other area educational institutions? / 

* the program director and proposal presenter(s) ' 
.will answe^r the questions in Table 1 in order 

, to determine, if the proposal merits further 
development, 'Each proposal will require in- 
dividualized analysis of the answers to Table 1. ^ 

-'However, in general, if any of .the answers (p. 16) 
receive numerical ratings of "0", the proposal • 

• should pot receive further consideration. 
Promising proposals should rec^eive.at least four 
numerical*ratlngs of 2 or* greater amorig the 
criteria. Far those ptogranv proposals Which'pas^ 
the prelipvLnai^^ screening, the program director 

/ must IDENTIFY and INVOLVE representatives of 
"appropriate pul^lics, i,e,, faculty, target g'roups, 
employers, and the general public in the remaining 
steps pf .the process,* 

'OTE: A formal Community IJeeds Assessment may 
serve to represent the general pirblic. 



EVALUATION OF EXISTING PROGRAMS _ ' 
^ 

^ ^ T 

STEP,1 - Involve, Appropriate Publics ^ * < 

The process of evaluating an exislting program should 
begin with the responsible program director IDENTIFYING 
and INVOLVING representatives of appropriate publics 
in the Evaluation process. Appropriate publics 
include faculty, students, employers, and the general 
public* : ■ , 

An evaluation te*^m must be broadly representative of 
various, viewpoints but not so large as to be 
ineffective^ Five to* seven active members should 
be appropriate. "*> f> 



DEVELOPMENT OF NEW PROG^lgAMg 
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STEP 2 - Identify Prograa Goals 'and Objectives 



'The responsible program director and'^representa- 
tives of appropriate publics must^next: 

* ^ Develop rough program ideas into a finished 

program concept, 

' ' ' \ K 

* The program concept includes estimates of 
program-demand. The need for the program must 
be related to specific community and student ' 
needs. Estimates of potential enrollment for 
the first ^two ye^rs of program implementation 
must be developed and documented. 



\e 



program Concepts also includes statements 
of" program objectives. The program bbjec^ives 
should include a hierarchy of curr;Lculuio and . 
cbllege competencies, curriculum outl'ine*, and 
desired outcomes of the prograiii, (see Fi^gure 2) 



NOT'E: All prggram objectives should be consistent 
~ with Cxillege objectives. ' _ ^ 



EVALUATION OF EXISTING , PROGRAMS 



STEP 2 - Identify Program Goals and, Obj ectj.v 



es 



The program director and evaluation team must next 

* .Determine the, program >goals and objectives. 
* PrQgram go^ls are broa'd statements of long term 
purpose. Program objec»tives- are. specif ic' 
statements of it^ended outcomes. If developed, 
should include curriculum and ►colieg^^ompe- ' 
tencies in ^ these objectives. 



*r Program objectives shobld state how tKe / ^ 
^ ^ \^curric\ilujii and' instrucstional modes utilized v ^ 
interact-to produce desir^, student outcomes. 



DEVELOPMENT 0? NEW PROGRAMS 



STEP 3 - State. Specific Objectives in Measurable Form 



To complete this step, the responsible program 
director must: 



* Specify objectives which are results-oriented, 

, spedify a timeframe, are quantitative and qual- 
itative.- -Refer to "An Approach to MBO Literature*', 
distributed by Dean Evans. * * 

EXAMPLES: Ik 1981, 60% of the graduate of.X 
% ]^ogram will transfer to four-yeat 
colleges in a program related to 
* ' their field of 'study at DCCC. • 

During the fitst'year of implemen- 
tation, 75% of the st\idents entering 

program will complete the first 
year. 

* Include objectives related to a broad range 
of educational outcomes. Refex to NCHEMS 
"Program Measures" and DCCC College Competencies. 

* Consult with MSPR for assistance iy idientlfying 
measurable outcomes. 

Presentation of Program Proposal fox Concep't Approval 

At. this point, the documentation developed in' Steps 
1-3 is summ^irizeii^nd presented to the appropriate 
group (s) for>approval o.f the program concept. 

NOTE: Approval of the concept is necessary before 
proceeding to StepjA^ ^ 



'EVALUATION- OF ^EXISTING. PROGRAMS 



^TEP 3 - State Specific Objectives in Measurable, 
^Form 



To complete this step, the porogram director and 
evaluation teanj. must: ' 

t ^ 

* Refine the program objectives and rest^e t^em 
in measurable f6rm. Only be deve^ping 
measurable objectives can th^ program be 
evaluated. 

* The program objectives must be , results-oriented, 
• specify a* -timeframe, and. be qualitative and 

quantitative. Refer to "An Approach to MBO • 
Literature" distributed by Dean Evans. .* 

* Develop a set of objectives -which cover rtie . 
broad range-of educational ou.tcomes« Refer to' 
NCHEMS "Program Measures" and DCCC* College 

. Competencies, 

* Consult with 'MSPR' for assistance in identifying 

measurable outcomes. * . ^ 

«. ^ ♦ • 

^ EXAMPLE: Within one year of commencement, 60% 

.of die gra'duates of X progiratn will hav( 
- • • transferred- to a. four year institution 
in a (!?urriculum- related to their DCCC 
^ major field of study. * 

Within two years of commencement, 75% 
of the employers of the graduaj:es of 
Y program will report that their DCCC 
^ employees are competent in t;hree .of 
^ four t;echnical skill areas. * 

. ^ ' * <^ . ^ 

' * i» • 
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DEVELOPMENT OF NEW PROGRAMS 

STEP 4 - Develop Appropriate Implementation/Measurement 
Techniques 

/ i 

' To complete this step, the responsible program 
director must: ^ - ^ 

* , Develop an implementation plan. The' plan must 

specify a beginning date which allows for recruit- 
ment of students, hiring needed staff, procure- ^ 
> ment of supplied, etc. 

* The plan must include an .estimated program budget 
for the first two yeaxs of implementation. " 

* The plan must specify numbers of students to be 
served and projected retention-completion rates 
for the first two years of th,-^ implementation. 

* The plan must , Identify existing; DCCC resources 
^to be used as well, as additional resourc,es 
Required,- space, personnel, equipment , •'etc^. ^ 

* Develop an evaluation plan. The program proposal 
.must specify how the success* of the program will 
be determined at, the end of the fist semestet, 
first year, second year, etc. 



Presentation of the Program Proposal^ for Implementation 

At *this point, the documentation developed through 
Steps 1-4 is sunnnarized and presented with supporting 
materials for implementation approval by appropriate 
decision-makers. ^ ' ^ 

NOTE:*. Consult with MSPR for assistance in utilizing"^ 
jneasures f rom ^institutional outcomes assessment 
/ • and- development of measures specific to the 

^ program being evaluated. 

ERIC , 12 . ■ 



EVALUATlOJ^ OF 'EXISTING PROGRAMS 



STEP 4 - Develop Appropriate Measurement Techniques 



V 

To complete this step, the program directc^r an'd 
evaluation team must: * . . ' 



Consult wit^l MSPR f ols^ssista^ce in utilizing. 
existing measures from institutional outcomes- 
assessments and coordination of additional 
measures specific to the ^program. . • , > 



The .^neasurement techniques 'to bemused should 
be base^i- on behaviors, tests, short and long' 
term, measures of /'career success", and 
Pl^ferably include competency assessments,* 

" ^ . ■ ^ ; V/ 

* Develop -a measurement pl^h. which specifies when 
and how measurements will be conducted. 
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, EVALUATION OF EXISTING & NEWLY ^ 

, 'Jf IMPLEMENTED' PROGRAMS ' 

STEP 5; - Measurement of Criteria for Achievement./^^ 
of Objectives ' , . ' ' 



The evaluation, team must ne^ implement the planned 
measurements systematically and with enough lead . 
time to provide data for institutional decisipn- * 
making processes- ^j- . / ^ - 



It is anticipated that most measurements will be 
conducted with the assistance of the staff of MSPR. 



HOTE: Steps* 5 - 8 are identical for existing programs 

and program proposals which haye been newly 
^ implemented. 
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EVALUATION -OF EXISTING & NEWLY 

IMPLEMEN T,ED PROGRAMS ' " 
' > , 



STEP 6 - Analysis of Data 

The evaliration t>4m next will consult with tut 
staff of MS^ for assistance in the tecHnical 
analysis of data. ^ ' 




EVALUATION OF EXISTINa>& N EWLY_ 
IMPLEMENTED PROGRAMS ' > 

\^ . 

STEP 7 - Interpretation of' Data ; 

The evaluation team must then relate the results 
of the measurements to state objectives and 
determine the degree of success relative* each 
objective. 0 

After sufficient measures ar^ accumulated, the 
team .must At^pret the" overall success of the 

program. - * 

J, 

* 1 , ' 

'■r 



EVALUATION OF EXISTING' & NEWLY 
I MPLEMEljTEP Pf^. OGRAMS__ 



STEP 8 - Recommendations 'for Revision of Goals and 
\ " Ohrjectives ; 



The cycle ends and begins-anew wh[en the program 
director reports the results of the evaluation 
to DCCC decision-makers with recoiwnendations for 
modifications to 'tlhe next )^av' s program goals 
and object:^ves^ , \ 
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Figure 2 
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ST IONS X ' 



How do/is 'the proposed program 
fit the stated goals of' 

DCC 



What is the demand/for the 
program in terms/bf enroll- 
ment and careej opportunities 
for gra'duates? 



Ho>? long can the* student 
demahd'for the program be 
expected to* last:?,. 



How long can carreer oppor- 
tunities be expected tp 
last? 



ANSWER CATAGORIES 

' / 

Does not f^t. 
Is appropriate. 

Is essential to fulfill mission. ' 
Has been identified as priority 
development areas. 

No^ demonstrated demand,. 
Evidence of student interest. 
Documented demand from 30 or more 

potential students. 
Documented demand for career , ^ 

opportunities.' ' * 

No evid^ence* to estimate. 
Estimate 1-3 years. , 
Estinfate 3-6 years.* ^ ^ * 
Estimate over 6 years.'* 



NUMERICAL 
■RATINGS 

0 
1 
2 
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No evidence to estimate, 
Estimate' 1-3 years. 
. Estimate ^-6 years . 
Estimate over 6 y^ars. 
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Resources How jn^ich can the program 
be expected to cost? 



Are additional- resources 
required to .implement the 
program? ^ ' , * 



Duplica- ^Will the program uijneces- 
tion . sarlly duplicate comparable 

^ program opportunities at 

other area institutions? 
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UNIVERSITY OF CACIF. 
. ■ LOS AiNGELES • 

CLEARINGHOUSE FOR 
. 'JIJWIOR COLLEGES , 



Expense greater than income. 
Expense equal to income. , 
Expense Ifess than income. 

Major physical plant addition 

or alteration. 
Laboratory facility or specialized 

equipHjent. 
Additional personnel. 
Instructional' supplies . 

Program openings exist at One or 
•more Del. Co- institutions 
Program openings exist a^- one or 

inpre "high cost^* Del. Co. 

institutions . 
Program exists but openings 

limitejd at one or more Del. CcT. 

institutlTDTts . , 
No co^iparabl^ programs exist in' 

Del. Co. ' * ' • 




